A stochastic optimal velocity model and its long-lived metastability 
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In this paper, we propose a stochastic cellular automaton model of traffic flow extending two 
exactly solvable stochastic models, i.e., the asymmetric simple exclusion process and the zero range 
process. Moreover it is regarded as a stochastic extension of the optimal velocity model. In the fun- 
damental diagram (flux-density diagram), our model exhibits several regions of density where more 
than one stable state coexists at the same density in spite of the stochastic nature of its dynamical 
rule. Moreover, we observe that two long-lived metastable states appear for a transitional period, 
and that the dynamical phase transition from a metastable state to another metastable /stable state 
occurs sharply and spontaneously. 



Traffic dynamics has been attracting much attention 
from physicists, engineers and mathematicians as a typi- 
cal example of non-equilibrium statistical mechanics of 
self-driven many particle systems for the last decade 
[E S Q • Statistical properties of traffic phenomena are 
studied empirically by using the fundamental diagram, 
which displays the relation of the flux (the average veloc- 
ity of vehicles multiplied by the density of them) to the 
density. We have been found an emergence of more than 
one different flux at the same density in the transit region 
from free to congested phase is almost universal in real 
traffic |4|. Recent experimental studies also show that 
the phase transition occurs discontinuously against the 
density and structurally complex states appear around 
the critical density [!, IS ■ 

While traffic models with many parameters and com- 
plex rules may reproduce empirical data, a strong math- 
ematical support, if any, allows a direct connection be- 
tween microscopic modelling and the universal feature 
extracted from various traffic flows. In this paper, we 
therefore propose a cellular automaton (CA) model ex- 
tending two significant stochastic processes, i.e., the 
asymmetric simple exclusion process (ASEP) and the 
zero range process (ZRP) as described later. More- 
over, we find that our model is supported by a success- 
ful traffic model, the optimal velocity (OV) model [1, Q. 
The OV model, which is a continuous and determinis- 
tic model, is expressed by coupled differential equations; 
d Xi/dt 2 = a[V(x,_|_i — Xi) — dxi/dt], where xt = Xi(t) is 
the position of the i-th vehicle at time t and the func- 
tion V is called the optimal velocity function, which gives 
the optimal speed of a vehicle according to its headway 
Xi+i — Xi (the i-th vehicle follows the (i-rT)-th in the same 
lane). The intrinsic parameter a indicates the driver's 
sensitivity to traffic situations and governs the stability 
of flow. Our stochatic CA model is, however, different 
from a noisy OV model [HI as described below. 



First of all, we explain the general framework of our 
stochastic CA model for one-lane traffic. N vehicles are 
moving on a single-lane road which is divided into a one- 
dimensional array of L sites. Each site contains one ve- 
hicle at most, and collision and overtaking are thus pro- 
hibited (the so-called hard-core exclusion rule). In this 
paper, parallel updating is adopted, i.e., all the vehicles 
attempt to move at each step. We introduce a probabil- 
ity distribution function w\ (m) which gives the probabil- 
ity, or the driver's intention, of the i-th vehicle hopping 
m (m = 0, 1, 2, . . .) sites ahead at time t. Then assuming 
that the next intention w t i +1 (m) is determined by a func- 
tion fi depending on w*(0),wj(l), . . . and the positions 
x\, x\, . . . , x l N , the configuration of vehicles is recursively 
updated according to the following procedure: 

For each vehicle, calculate the next intention to hop 

and 



m sites with the configuration x\, 
the intention u>*(0), w\(l), . . .; 



x\, . 



wl +1 (m) = fi(wl(0),wi(l), ...:.r\ ,\:,n). (1) 

• Determine the number of sites V* +1 at which a ve- 
hicle moves (i.e. the velocity) probabilistically ac- 
cording to the intention In other words, the 
probability of V* +1 = m is equal to w t i +1 (m). 



Each vehicle moves avoiding a collision; 



C * +1 =^+min(Ax*, V* +1 ), 



(2) 



where Ax* 



1 defines the headway, 



and the vehicles thus move at either V* +1 or Ax* 
sites. If V* +1 > Ax*, a vehicle must stop at the cell 



1. 



In what follows, we assume that the maximum allowed 
velocity is equal to 1, i.e., if m ^ 2, w\{m) = 0. Then, 
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FIG. 1: Schematic view of the tagged-particle model for 
ASEP(a) and ZRP(b). The hopping probability of a parti- 
cle depends on the gap size in front of it in ZRP, while it is 
always constant in ASEP. In both cases, hopping to an occu- 
pied cell is prohibited. 



putting v\ 



tuf(l) (accordingly iw|(0) — 1 — vj), we 



propose a special type of ft in ([T]) as 

vl +1 = (1 - ai)v\ + ai Vi(Axl) (Vt > 0, Vi), (3) 

where a,i (0 < a, < 1) is a parameter and the function 
Vi is restricted to values in the interval [0, 1] so that v\ 
also should be within [0,1]. The intrinsic parameter a*, 
a weighting factor of the optimal velocity Vi{Ax\) to the 
intention , corresponds to the driver's sensitivity to a 
traffic condition. As long as the vehicles move separately, 
we can also rewrite ([2]) simply as = x\ + 1 with 

probability v\ +1 . (Note that the original OV model does 
not support the hard-core exclusion 

dill.) Therefore, 

v\ can be regarded as the average velocity, i.e., = 
{x\) + v\ +1 in the sense of expectation values. We call 
the model expressed by ([3]) the stochastic optimal velocity 
(SOV) model because of its formal similarity to a discrete 
version of the OV model (or a coupled map lattice |ll|) 



t+1, 



t+1 =(1 - aAt)v\ - 



v 



(aAt)V(Axl), 



(4) 
(5) 



where At is a time interval and the OV model is recov- 
ered in the limit At — > 0. In this special case that the 
maximum allowed velocity equals to 1, we thus have an 
obvious correspondence of our stochastic CA model to 
an existent traffic model. As a matter of convenience, we 
set ai — a and Vi — V (Vi) hereafter. 

From the viewpoint of mathematical interest, the SOV 
model includes two significant stochastic models. When 
becomes = vL i.e., the model reduces to 



ASEP 




with a constant hopping probabil- 
,t+i 



ity p = w 2 u . When a = 1, © becomes v\ +1 = V(Axj), 
i.e., the model reduces to ZRP [3] considering the head- 
ways {Ax*} as the stochastic variables of ZRP. In ZRP, 
the hopping probability of a vehicle is determined ex- 
clusively by its present headway. FigQ] illustrates the 
two stochastic models schematically. ASEP and ZRP are 
both known to be exactly solvable in the sense that the 
probability distribution of the configuration of vehicles 
in the stationary state can be exactly calculated [l?], [HI , 
and thus our model admits an exact calculation of the 
fundamental diagram in the special cases. 

In order to investigate a phenomenological feature, we 
take a realistic form of the OV function as 



V(x) 



tanh(a; — c) + tanh c 
1 + tanh c 



(6) 
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FIG. 2: The fundamental diagram of the SOV model with the 
OV function (J6]) (c=1.5 and a = 0.01) plotted at each time 
stage t, starting from uniform/random states with p (= vf ) = 
0.5, including the exact curve(gray) of ASEP for comparison 
[13]. The system size is L = 1000. 



which was investigated in [8j. We find that the funda- 
mental diagrams simulated with ([6]) have a quantitative 
agreement with the exact calculation of ZRP (a = 1) 
up to a ~ 0.6. In contrast, the fundamental diagram of 
the SOV model does not come closer to that of ASEP 
as a approaches to although the SOV model coincides 
with ASEP at a = 0. Fig. [5] shows that a curve sim- 
ilar to the diagram of ASEP appears only for the first 
few steps (t = 10) and then changes the shape rapidly 
(t = 100, 1000). Surprisingly, when the diagram be- 
comes stationary, it allows a discontinuous point and two 
overlapping stable states around the density p ~ 0.14 
(t = 10000). 

Let us study the discontinuity of the flux in detail. 
Fig. [3] shows the fundamental diagram expanded around 
the discontinuous point. We have three distinct branches 
and then call them as follows: free-flow phase (vehicles 
move without interactions), congested phase (a mixture 
of small clusters and free vehicles), and jam phase (one 
big stable jam transmitting backward). These branches 
appear in the fundamental diagram, respectively as a seg- 
ment of line with slope l(free-flow), as a thick curve with 
a slight positive slope (congested), and as a thick line with 
a negative slope(jam). Note that the congested and jam 
lines shows some fluctuations due to a randomness of 
the SOV model. Fig. [3ja) shows snapshots of the flux 
at t = 1000 and 5000. There exists midstream flux be- 
tween free-flow and congested phases at t = 1000, and 
between congested and jam phases at t = 5000. This 
suggests that the high-density free-flow states can hold 
until t = 1000 but not until t = 5000, and that the 
high-density congested states have already started to de- 
cay into jam states before t = 5000. We have thereby 
revealed the existence of two metastable branches lead- 
ing out of the free-flow or congested lines. Comparing 
FigJ3fa) with Fig. [3Jb), we have six qualitatively dis- 
tinct regions of density(FigJ3]^b)); free region S\ (includ- 
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FIG. 3: (a)The expanded fundamental diagram of the SOV 
model with a = 0.01 at t = 1000 (gray) and t = 5000 (black) 
starting from two typical states; the uniform state with equal 
spacing of vehicles and p (= v ( ') — 1, and the random state 
with random spacing and p = 1. We observe three distinct 
branches, which we call the free-flow, congested, and jam 
branch. They survive even in the stationary state, which is 
plotted at t = 50000 in (b). (b)The stationary states (black) 
and the averaged three branches (gray lines) are plotted at 
t — 50000. The vertical dotted lines distinguish the regions of 
density from Si to B-2- The arrows in T2 indicate the trace of 
a metastable free-flow state decaying to the lower branches, 
(see also Fig. [4}. 



ing only free-flow phase), bistable region B\ (including 
free- flow and congested phases, which are both stable), 
instable region T\ (including all the three phases, which 
are all stable), tristable region T2 (including free-flow, 
congested and jam phases. The former two phases are 
stable and the last one is metastable), bistable region 
B2 (including congested and jam phases. The former is 
metastable, and the latter is stable), and jam region S2 
(including only stable jam phase, which is not displayed 
here). We stress that the tristable region T\ is a novel 
and remarkable characteristic of many-particle systems, 
and that the successive phase transitions from a free-flow 
state to a jam state via a congested state occur respec- 
tively on a short time scale. 

Let us study the dynamical phase transition especially 
at the density p = 0.14, indicated by successive arrows in 
Fig. [3jb). Fig. [Uupper) shows the flux plotted against 
time. It is striking that there appear three plateaus 
which respectively correspond to a free-flow state, a con- 
gested state, and a jam state, and that the flux changes 
sharply from one plateau to another. In other words, the 
metastable states have a remarkably long lifetime before 
undergoing a sudden phase transition. Stochastic mod- 
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FIG. 4: The time evolution of flux at the density p = 0.14 
starting from the uniform state. We observe two plateaus at 
the flux Q = 0.14 with a lifetime T ~ 5000, and Q ~ 0.08 with 
T ~ 7000 before reaching the stationary jam state(upper). 
The lower figure shows the corresponding spatio-temporal di- 
agram, where vehicles (black dots) move from bottom up. 
(Note that the periodic boundary condition is imposed.) 



els, in general, are not anticipated to have such long-lived 
metastable states because stochastic fluctuations break a 
stability of states very soon [?J • Fig. HJlower) shows the 
spatio-temporal diagram corresponding to the dynami- 
cal phase transition. Starting from a free-flow state, the 
uniform configuration stochastically breaks down at time 
t ~ 5000, and then the free-flow state is rapidly replaced 
by a congested state where a lot of clusters are forming 
and dissolving, moving forward and backward. Fig. 
shows the distribution of headways at several time stages. 
We find that the distribution of headways changes signif- 
icantly after each phase transition. In particular, the 
ratio of vehicles with null headway increases. As for a 
congested state, it is meaningful to evaluate the average 
size of clusters from a distribution of headways. If the 
ratio of the vehicles with null headway is bo, the average 
cluster size I can be evaluated as 1/ (1— bo). In the present 
case, the average size of clusters is about 1.2 ~ 1.4 dur- 
ing t = 6000 ~ 12000. We also have some remarks, from 
a microscopic viewpoint, on a single cluster: Since the 
sensitivity parameter a is set to a small value, the inten- 
tion v\ does not change a lot before the vehicle catches 
up with the tail of a cluster(i.e. v\ ~ 1). Accordingly, 
the aggregation rate a is roughly estimated at the den- 
sity of free region behind the cluster; a ~ (1 — bo)p- In 
the present case, the aggregation rate averaged over the 
whole clusters of a congested state is 0.10 ~ 0.12. For the 
same reason, we can estimate the average velocity of the 
front vehicle of a cluster at (1 — a) e ^ s , where S denotes 
the dissolution rate and t/8 indicates the duration of cap- 
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FIG. 5: The distribution of the headways with which the 
vehicles move at each time stage t. It changes a lot after 
phase transitions^ ~ 5000, 12000). The traffic states, free- 
flow^ < 5000), congested(5000 < t < 12000), and jam(i > 
12000) respectively show their specific pictures. 



ture. Since S is also equivalent to the average velocity of 
the front vehicle, it amounts roughly to 1 — al after all. 
In the present case, the dissolution rate averaged over the 
whole clusters of a congested state is 0.86 ~ 0.88. Then, 
the average lifetime of the clusters £/(5 — a) is estimated 
at 1.54 ~ 1.89. The above estimations are appropriate 
only when clusters are small and spaced apart. As many 
clusters arise everywhere and gather, a vehicle out of a 
cluster tends to be caught in another cluster again be- 
fore it recovers its intention at full value. Consequently, 



the clusters arising nearby reduce their dissolution rates, 
and finally grow into a jam moving steadily backward. 
The steady transmitting velocity (the aggregation rate) 
is estimated at —0.055, coinciding with Fig. 2] 



In this paper, beginning with a general scheme, we 
have proposed a stochastic CA model to which we in- 
troduce a probability distribution function of the vehi- 
cle's velocity. It includes two exactly solvable stochastic 
processes, and it is also regarded as a stochastic gen- 
eralization of the OV model. Moreover, it exhibits the 
following features: In spite of a stochastic model, the 
fundamental diagram shows that there coexist two or 
three stable phases (free-flow, congested, and jam) in 
a region of density. As the density increases, the free- 
flow and congested states lose stability and change into 
metastable states which can be observed only for a tran- 
sitional period. Moreover the dynamical phase transition 
from a metastable state to another metastable/stablc 
state, which is triggered by stochastic perturbation, oc- 
curs sharply and spontaneously. We consider that the 
metastable state may be relevant to the transient con- 
gested state observed in the upstream of on-ramp [j| [nj . 
Such a dynamical phase transition has not been observed 
in previous works [H, H [13] or among existent many- 
particle systems. Further studies, e.g., on another choice 
of the OV function, under open boundary conditions, and 
on the general (i.e. multi-velocity) version will be given 
in subsequent publications [20] |. 
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